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Abstract In this paper, we consider the problem of quantifying systemic redundancy in re¬ 
liable systems having multiple controllers with overlapping functionality. In particular, we 
consider a multi-channel system with multi-controller configurations - where controllers are 
required to respond optimally, in the sense of best-response correspondence, a reliable-by- 
design requirement, to non-faulty controllers so as to ensure or maintain some system prop¬ 
erties. Here we introduce a mathematical framework, based on the notion of relative entropy 
of probability measures associated with steady-state solutions of Fokker-Planck equations 
for a family of stochastically perturbed multi-channel systems, that provides useful infor¬ 
mation towards a systemic assessment of redundancy in the system. 

Keywords Entropy ■ Fokker-Planck equation ■ Liouville equation ■ quantification of 
systemic redundancy • random perturbation • relative entropy • reliable systems 


1 Introduction 


The notion of redundancy, which promotes robustness by “backing-up” important functions 
of systems, together with its systemic quantification, has long been recognized as an es¬ 
sential design philosophy by researchers in different fields of studies (to mention a few, 
e.g., see 03,03 and f22l for related discussions in biological systems; see also 0.03. 
03 and 03 for related discussions in engineering systems). In this paper, we consider the 
problem of quantifying systemic redundancy in reliable systems having multiple controllers 
with overlapping functionality. To be more specific, we consider a multi-channel system 
with multi-controller configurations - where controllers are required to respond optimally, 
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a reliable-by-design requirement, to non-faulty controllers so as to maintain the stability of 
the system when there is a single failure in any of the control channels. 

Here we introduce a mathematical framework, based on the notion of relative entropy of 
probability measures associated with steady-state solutions of the Fokker-Planck equations 
for a family of stochastically perturbed multi-channel systems, that provides useful infor¬ 
mation towards a systemic assessment of redundancy in the system. For such steady-state 
solutions of the Fokker-Planck equations, we establish a quantifiable redundancy measure 
by using the difference between the average relative entropy of the steady-state probability 
measures, with respect to any single controller failure in the system, and the entropy of the 
steady-state probability measure under a nominal operating condition, i.e., without any sin¬ 
gle controller failure in the system. Moreover, we determine the asymptotic behavior of the 
systemic redundancy measure in the multi-channel system as the random perturbation de¬ 
creases to zero, where such an asymptotic result can be related to the solutions of controlled 
Liouville equations for the underlying original unperturbed multi-channel system. 

It is worth mentioning that some interesting studies on systemic measures, based on infor¬ 
mation theory, have been reported in literature (e.g., see Cl or jS] in the context of 
complexity, degeneracy and redundancy measures in biological systems; see llT2l or llT3l in 
the context of robustness in biological systems; and see also (4j| or (6] for related discussion 
on the complexity measure for trajectories in dynamical systems). Moreover, such studies 
have also provided some useful information in characterizing or understanding the systemic 
measures (based on mutual information between appropriately partitioned input and out¬ 
put spaces) in systems with multiple subsystems/modules having overlapping functionality. 
Note that the rationale behind our framework follows in some sense the settings of these 
papers. However, to our knowledge, this problem has not been addressed in the context of 
reliable systems with multi-controller configurations having “overlapping or backing-up” 
functionality, and it is important because it provides a framework for quantifying or gauging 
systemic redundancy measure in multi-channel systems, for example, when there is a single 
channel failure in the system. 

This paper is organized as follows. In Section]^ we present some preliminary results that 
are useful for our main results. Section 0 presents our main results, where we introduce a 
mathematical framework that provides useful information towards a systemic assessment 
of redundancy in reliable systems. This section also contains a result on the asymptotic 
behavior of the systemic redundancy measure in the multi-channel system as the random 
perturbation decreases to zero. 


2 Preliminary results 

Consider the following continuous-time multi-channel system 



a;(0) = xo, 


( 1 ) 


where a; G is the state, m G is the control input to the ith-channel. 

Let S' be a compact manifold in and let po(x) = p(0, x) > 0, with po{x)dx = 1, be 
an initial density function. Further, let ip he a smooth function ip: S ^ K"'' having compact 
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support, then the expected value of ip at some future time f > 0 is given by 

E{^ip{x)'\ = / ip{x)p{t,x)dx. (2) 

Js 

Moreover, if we take the time derivative of the above equation and make use of integration 
by parts, then we will have 

= - j^ip{x)(^-^, (^Ax + BiU^p{t,x)^dx. (3) 

Since ip{x) is an arbitrary function, we can rewrite the above equation as a first-order partial 
differential equation (which is also known as the Liouville equation) 


Remark 1 Here we remark that the above first-order partial differential equation describes 
how the density function p{t, x) evolves in time (i.e.. Equation Q describes an evolution 
equation on Li (K'^) under a flow defined by the deterministic system of ([T]i). Furthermore, 
it is easy to verify that 

p{t, a;) > 0, f > 0, 

and further it satisfies 



Notice that the partial derivative with respect to a; in (|4]i depends on whether the input 
controls Ui are expressed as open-loop functions (i.e., Ui = Ui(t) for i = 1,2,..., N) or as 
closed-loop functions (i.e., Ui = Ui{t, x) for i = 1,2,..., Np, and, as a result of this, the 
solution for p{t, x) depends on the type of input controls used in the system. 

Remark 2 Recently, using a class of variational problems, the author in a has considered 
the Liouville equations that involve control terms. Moreover, such a formulation is useful 
for relating the behavior of the solutions of the Liouville equation to that of the behavior of 
the underlying differential equation of the system. 

In what follows, we recall some known results that will be used for our main results (e.g., 
see (7]| or fTSl ). 

Definition 1 Let /r be a probability measure on with respect to the density function 
p(t, x) which satisfies the Liouville equation in Q starting from an initial density function 
po(xo)- Then, the entropy of p (with respect to Lebesgue measure) is defined by 

H[p) = — / p{t, x) \og 2 p{t,x)dx, t > 0. 

Js 


( 5 ) 
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Remark 3 In general, we have the following inequality 

- / pi{t,x)log2 pi{t,x)dx < - / pi{t,x)log2 P2{t,x)dx, 

Js Js 

for any two density functions pi{t,x) and p2{t,x) that satisfy (|4ll starting from pi, 0 ( 3 ^ 0 ) 
and p2,oixo), respectively. 

Definition 2 Let pi and p 2 be two probability measures on with respect to the density 
functions pi(f, x) and p2{t,x) that satisfy the Liouville equation in (|4]i starting from initial 
density functions pi,o(xo) and p2,o(xo), respectively. Then, the relative entropy of p 2 with 
respect to pi is defined by 

-D(p 2 ||pi)= [ p 2 {t,x)\og 2 dx 

Js \Pi{t,x)J 

P2{t,x)\0g2 P 2 {t,x) - P2{t,x)\0g2 Pl{t,x)^dx, t > 0. ( 6 ) 

Remark 4 Note that the relative entropy (also called the Kullback-Leibler distance) D (p 2 || pi), 
which measures the deviation of p 2 with respect to the probability measure pi, is nonnega¬ 
tive, i.e., D[p ,2 II pi) > 0, and L>(p 2 || pi) = 0 if and only if p 2 = pi. 

Next, consider the following stochastically perturbed multi-channel system 



dx'^it) = Ax^{t)dt + BiUi{t)dt + ea{x^{t))dW{t), a;'^(0) = rco, (7) 


where 

- x^{-) is an -valued diffusion process, e > 0 is a small parameter that represents the 
level of random perturbation in the system, 

- (T: R'* —>■ is Lipschitz continuous with the least eigenvalue of uni¬ 

formly bounded away from zero, i.e., 

a{x)a'^{x) > Kidxd, Va; G R*^, 


for some k > 0, 

- W{-) (with W (0) = 0) is an m-dimensional standard Wiener process, and 

- Ui(-) is a (7i-valued measurable control process to the ith-channel (i.e., an admissible 
control from the set Ut C R"^’) such that, for all t > s,W(t) — W (s) is independent of 
Ui{iy) for V > s. 

Note that the time evolution of the density function p''(f, x) associated with (|7]i satisfies the 
following second-order partial differential equation (i.e., the Fokker-Planck equation) 


dp^{t,x) 






a{x)a'^{x)p%t,x)y 

p’^{0,x) is given. (8) 


dt 
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In this paper, among all solutions of the above Fokker-Planck equation, we will only con¬ 
sider the steady-state solution that satisfies the following stationary Fokker-Planck equa- 
tioifl 


0 = - 




( 9 ) 


In the following section, i.e., Section[3l such a steady-state solution, together with the solu¬ 
tion of the Liouville equation, will allow us to provide useful information towards a systemic 
assessment of redundancy in the reliable multi-channel systems with small random pertur¬ 
bation. 


3 Main results 


In what follows, we consider a particular class of stabilizing state-feedbacks that satis¬ 
fied 


/CC J {K,,K2,...,Kn) + C 


C“ & 


+ cC-, J = (10) 


Remark 5 We remark that the above class of state-feedbacks is useful for maintaining the 
stability of the closed-loop system both when all of the controllers work together, i.e., (A -|- 
BiKi), as well as when there is a single-channel controller failure in the system, 
i-=-. BiKi) for j = 1, 2,..., Moreover, such a class of state-feedbacks 

falls within the redundant/passive fault tolerant controller configurations with overlapping 
functionality, i.e., a reliable-by-design requirement in the system (e.g., see (Tl or O). 


Note that, for such a class of state-feedbacks, the density functions (t, x) for j = 
0,1,..., satisfy the following family of Liouville equations 


dp^°\t, 

dt 


—, (Ax + B,K,x)p^°\t, x)) 


and 


X)), j = 1,2,..., N, 


( 11 ) 


( 12 ) 


^ For example, see II11 or 1211 for additional discussion on the limiting behavior of invariant measures for 
systems with small random perturbation. 

^ Sp(A) denotes the spectrum of a matrix A G i.e., Sp(A) = {s E C | rank(A — si) < d}. 
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Starting from an initial density function po(^o)- Moreover, using the fact that the solution 
of 


i;(t) = ^BiKi^x{t), x{0) = xo, 


(13) 


can be written as 

a;(t) = exp(At)a;(0) + / exp{A(t — A)) VJ BiKix{\)d\. (14) 

Then, the density function (f, a;) (when j = 0) corresponding to the Liouville equation 
in O, with an initial density po(xo), is given by 

(t, x) = ^exp(-Af) (^x{t) - j exp(A(f - A)) BiKix{X)dX^ 

( 15 ) 

Similarly, the density functions p^^\t,x) (when j = 1,2,... ,7V) corresponding to the 
Liouville equations in (112b are given by 

x) = ^exp(-Af) ^a;(f) - j exp(A(f - A)) BiKix{\)d>^ 

( 16 ) 


On the other hand, for a given random perturbation (cr, e), the steady-state density functions 
p(<5.7)(2 ,) Pqj. j — 0,1,... ,7V, satisfy the following family of stationary Fokker-Planck 
equations 


0 = - 





and 






N 

¥^j 


B^KixJp^^’°\x)^+^(^-^, a{x)a'^{x)p^^'°\x)y 

> 0, f p^''’°\x)dx = I, (17) 

jR'i 

B,K,x^p^'''^\x)'^ + ^(^-^, a{x)a'^{x)p^^'^\x)y 


p^^’^\x)>0, j p^^’^\x)dx = I, y = 1,2, ...,7V. 
jR'i 


(18) 


Remark 6 Note that a{x) is Lipschitz continuous, with the least eigenvalue of a(-)a'^(-} 
uniformly bounded away from zero. Further, if it is twice differentiable on the unique¬ 
ness for smooth steady-state solutions for ([nil and dlSb depends on the behavior of the 
original unperturbed multi-channel system as well as on the type of input controls used in 
the system. 


The following proposition provides a condition on the uniqueness of the solutions for the 
stationary Fokker-Planck equations. 
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Proposition 1 Suppose that there exists at least one N-tuple stabilizing state-feedbacks that 
satisfies the conditions in GoJ. Then, there exist unique smooth density functions 
for j = 0,1,. . . , N, with respect to {a, e), corresponding to the stationary Fokker-Planck 
equations in Gl} and (H. 

Furthermore, the relative entropy of for i = 1,2,. . . , N, with respect to (i.e., 

probability measures associated with the density functions and p^^’^^{x), respec¬ 

tively) is finite, i.e., 


<+00. (19) 

Proof Suppose that (j{x) is twice differentiable on Let the Af-tuple of state-feedbacks 
(ii'i, K 2 ,... ,Kn) satisfy the conditions in lllOt . Then, the origin is a stable equilibrium 
point for the original unperturbed multi-channel system in (|T]l (with respect to this particular 
set of state-feedbacks). Moreover, for sufficiently small e > 0, there exists a Lyapunov 
function V{x) > 0, with lim| 3 ,|_>.cc V{x) = -|-cx), such thaS 

(J^Ax V{x)'^+ ^(a{x)a'^{x)-^, V{x)^ < -q, (20) 

and 

+ V{x)) + ^(^a{x)a^{x)^, V{x)) < -q, 

j = l,2,...,N, (21) 

for all X G IR‘*\{0} and for some constant q > 0. Then, from Theorem 2.1 and Theo¬ 
rem 5.7 in 0, the stationary measures for j = 0,1,..., of the Fokker-Planck 

equations in ( 117b and dlSb uniquely admit smooth density functions G for 

j = 0,1,..., N, with > 0 on K'*, i.e., 

{dx) = {x)dx, j = 0,1,..., N. 

Furthermore, the measure for i G {1, 2,..., A^}, is absolutely continuous with respect 
to (i.e., p*''^’°\ i = 1,2,..., N) and, as a result, the relative entropy of 

p^''’*^{ 2 :) with respect to p^'^’^^(x) satisfies the following 

II p('=’°^) < -boo, i = l,2,...,N. 

This completes the proof. 

Next, let us define the systemic redundancy r(o.,e) G K (with respect to the random pertur¬ 
bation (cr, e)) as follows 

(22) 

where (l/2A^) || p(c.o)^ represents the average relative entropy of proba¬ 

bility measures with respect to any single failure in the control channels. 


^ Note that the assumption of a common Lyapunov function V(x) is not necessary in {20j and (SD. 
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Remark 7 Here we remark that '''(^,6) provides useful information in characterizing the sys¬ 
temic redundancy (i.e., with respect to the state-space and partitioned input spaces) in the 
system with multi-controller configurations having overlapping functionality, i.e., a require¬ 
ment to maintain the stability of the system when there is a single failure in any of the control 
channels. 

Then, we have the following result on the asymptotic property of the systemic redundancy 
measure r-(o.as the random perturbation decreases to zero (i.e., as e —^ 0). 

Corollary 1 Suppose that Proposition\I\holds, then the redundancy r(a,e) satisfies the fol¬ 
lowing asymptotic property 


’’((T.e) roo as e ^ 0, 


(23) 


where 


too = lim 

t —^OO 


= rt, t>0 


(24) 


and pS^\ j = 0, 1,.. ., are probability measures with respect to the density functions 
p^^\t, x), j = 0,1,. . . , A^, respectively, that satisfy the Liouville equations in (Hill and 
dH starting from an initial density function pq{xq). 

Remark 8 The proof is based on the idea of comparing the solutions of the Liouville equa¬ 
tions to that of the steady-state solutions of the Fokker-Planck equations as e ^ 0, and thus 
it is omitted. 

Remark 9 Note that a closer look at Equation ( 122b (see also Equations (123b and (124b above) 
shows that '('(o- > rt, Vf > 0, with respect to some perturbation (a, e) and further if 

ei < 62 , then 
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